Search results for "Sonic interaction"

showing 10 items of 18 documents

A Case of Cooperative Sound Design

2016

In this design case study, protocol and linkographic analysis are applied to a task of cooperative vocal sketching, proposed in the scope of educational research activities. The understanding of the cognitive behaviors involved in sound creation is aimed at setting the ground for the development of rigorous, designerly evaluation practices tailored to sound design, all the way to the final interactive product. Relevant qualitative and quantitative information about the creative process informs the assessment and possibly improvement of sound design methods.

Settore INF/01 - InformaticaScope (project management)Computer scienceProcess (engineering)4. EducationSound design05 social sciences020207 software engineering02 engineering and technologyProduct sound designTask (project management)Design cognitionEducational researchDesign theoryHuman–computer interactionSonic interaction designSettore ICAR/13 - Disegno Industriale0202 electrical engineering electronic engineering information engineeringDesigntheory0501 psychology and cognitive sciencesSonic interaction designProtocol (object-oriented programming)Vocal sketching050107 human factorsProceedings of the 9th Nordic Conference on Human-Computer Interaction
researchProduct

miMic

2016

miMic, a sonic analogue of paper and pencil is proposed: An augmented microphone for vocal and gestural sonic sketching. Vocalizations are classified and interpreted as instances of sound models, which the user can play with by vocal and gestural control. The physical device is based on a modified microphone, with embedded inertial sensors and buttons. Sound models can be selected by vocal imitations that are automatically classified, and each model is mapped to vocal and gestural features for real-time control. With miMic, the sound designer can explore a vast sonic space and quickly produce expressive sonic sketches, which may be turned into sound prototypes by further adjustment of model…

sonic interaction design system architecture vocal sketching sound designSound (medical instrument)Settore INF/01 - InformaticaInformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.HCI)Computer scienceMicrophoneSound designSpeech recognition05 social sciencesModel parameterssystem architecturevocal sketchingsonic interaction designAugmented microphone050105 experimental psychologysound designGestureInertial measurement unitSonic interaction designSettore ICAR/13 - Disegno Industriale0501 psychology and cognitive sciences050107 human factorsPencil (mathematics)GestureProceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction
researchProduct

Interaction by ear

2019

Abstract Speech-based interaction is now part of our everyday experiences, in the home and on the move. More subtle is the presence of designed non-speech sounds in human-machine interactions, and far less evident is their importance to create aural affordances and to support human actions. However, new application areas for interactive sound, beyond the domains of speech and music, have been emerging. These range from tele-operation and way-finding, to peripheral process monitoring and augmented environments. Beyond signalling location, presence, and states, future sounding artifacts are expected to be plastic and reconfigurable, and take into account the inherently egocentric nature of so…

Settore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniAuditory displaySonificationSettore INF/01 - InformaticaSonic information designProcess (engineering)Computer scienceGeneral EngineeringRepresentation (systemics)Human Factors and ErgonomicsInteraction designSonic interaction design Sonic information design Sonification Auditory displayEducationHuman-Computer InteractionHardware and ArchitectureHuman–computer interactionSonic interaction designAffordanceSoftware
researchProduct

Sounding objects in Europe

2014

Sound design has been shifting and enlarging its scope to those contexts and applications where interactivity is of primary importance. A chain of research projects funded by the European Commission has been playing a driving role in the definition of the new discipline of sonic interaction design. Such projects are briefly reviewed in order to outline a research thread that is expected to continue nourishing sound science and design.

Sounding objectsDepth soundingCommunicationEngineeringArchitectural engineeringInteractivitySettore INF/01 - Informaticabusiness.industrySonic Interaction DesignSound designSonic interaction designEuropean commissionbusinessThe New Soundtrack
researchProduct

Cooperative sound design: a protocol analysis

2016

Formal protocol analysis and linkographic representations are well-established approaches in design cognition studies, in the visual domain. We introduce the method and tools in the auditory domain, by analysing a case of collaborative sound design. We show how they can provide relevant qualitative and quantitative information about the efficiency of the creative process.

sound design; protocol analysis; linkographyProtocol analysiSettore INF/01 - InformaticaComputer scienceProcess (engineering)Sound designprotocol analysis0211 other engineering and technologiesProtocol analysis02 engineering and technologyDesign cognitionDomain (software engineering)sound designHuman–computer interactionSonic interaction designlinkographySettore ICAR/13 - Disegno Industriale0202 electrical engineering electronic engineering information engineering020201 artificial intelligence & image processingSonic interaction design021106 design practice & management
researchProduct

Sketcching sonic interactions

2019

This chapter provides an overview of methods and practices for sketching sound in interactive contexts. The chapter stresses the role and importance of producing and interacting with provisional sound representations in conceptual sound design. The cognitive benefits of embodied sound sketching are discussed and outlined by means of practical examples and basic exercises. In particular, vocalizations and gestures are proposed as primary cognitive artifacts available to sound designers to enact sonic impressions and displays, cooperatively.

geographygeography.geographical_feature_categorySettore INF/01 - InformaticaComputer scienceSound designCognitiondesign cognitionsonic interaction designVocal sketching design cognition sound designsound designHuman–computer interactionEmbodied cognitionSettore ICAR/13 - Disegno IndustrialeCognitive artifactsSound (geography)Vocal sketchingGesture
researchProduct

Growing the practice of vocal sketching

2015

Sketch-thinking in the design domain is a complex representational activity, emerging from the reflective conversation with the sketch. A recent line of research on computational support for sound design has been focusing on the exploitation of voice, and especially vocal imitations, as effective representation strategy for the early stage of the design process. A set of introductory exercises on vocal sketching, to probe the communication effectiveness of vocal imitations for design purposes, are presented and discussed, in the scope of the research-through-design workshop activities of the EU project SkAT-VG

sound designSettore INF/01 - Informaticaauditory displaysketchingSettore ICAR/13 - Disegno Industrialevocal sketchingsonic interaction designauditory display vocal sketching sonic interaction design
researchProduct

Embodied sound design

2018

Abstract Embodied sound design is a process of sound creation that involves the designer’s vocal apparatus and gestures. The possibilities of vocal sketching were investigated by means of an art installation. An artist–designer interpreted several vocal self-portraits and rendered the corresponding synthetic sketches by using physics-based and concatenative sound synthesis. Both synthesis techniques afforded a broad range of artificial sound objects, from concrete to abstract, all derived from natural vocalisations. The vocal-to-synthetic transformation process was then automated in SEeD, a tool allowing to set and play interactively with physics- or corpus-based sound models. The voice-dri…

Range (music)sound synthesisProcess (engineering)Sound designHuman Factors and Ergonomicsvocal sketchingsonic interaction design01 natural sciences050105 experimental psychologyEducationHuman–computer interaction0103 physical sciencesSettore ICAR/13 - Disegno IndustrialeNatural (music)0501 psychology and cognitive sciencesSet (psychology)010301 acousticsSound (geography)embodimentSettore ING-INF/05 - Sistemi Di Elaborazione Delle Informazionigeographygeography.geographical_feature_categorySettore INF/01 - Informatica05 social sciencesGeneral EngineeringSound designHuman-Computer InteractionHardware and ArchitectureEmbodied cognitionSound design; embodiment; vocal sketching; sound synthesisSoftwareGesture
researchProduct

Bauhaus Legacy in Research through Design: The Case of Basic Sonic Interaction Design

2014

Settore INF/01 - InformaticaSonic Interaction Designprocedural audiobasic designsonic interaction design; basic design; procedural audio
researchProduct

Multisensory texture exploration at the tip of the pen

2016

A tool for the multisensory stylus-based exploration of virtual textures was used to investigate how different feedback modalities (static or dynamically deformed images, vibration, sound) affect exploratory gestures. To this end, we ran an experiment where participants had to steer a path with the stylus through a curved corridor on the surface of a graphic tablet/display, and we measured steering time, dispersion of trajectories, and applied force. Despite the variety of subjective impressions elicited by the different feedback conditions, we found that only nonvisual feedback induced significant variations in trajectories and an increase in movement time. In a post-experiment, using a pa…

3304Computer scienceRealization (linguistics)ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONHuman Factors and ErgonomicsMultisensory Textures02 engineering and technologyTexture (music)Multisensory textureEducationEngineering (all)Sonic Interaction DesignSonic interaction design0202 electrical engineering electronic engineering information engineeringComputer visionEngineering(all)Pen-based interaction; Pseudo-haptics; Multisensory textures; Sonic interaction designPseudo-hapticComputingMethodologies_COMPUTERGRAPHICSSettore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniSettore INF/01 - Informaticabusiness.industryMovement (music)Work (physics)General Engineering020207 software engineeringMultisensory textures; Pen-based interaction; Pseudo-haptics; Sonic interaction design; Human Factors and Ergonomics; Software; 3304; Engineering (all); Human-Computer Interaction; Hardware and ArchitectureHuman Factors and ErgonomicPseudo-hapticsHuman-Computer InteractionPen-based InteractionHardware and Architecture020201 artificial intelligence & image processingArtificial intelligencebusinessStylusSoftwareGraphics tabletGesture
researchProduct